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DISPLAY METHOD AND SYSTEM 

Cross-Reference to Related Applications 
and Assertion of Small Entity Status 
[0001] This application relates to and claims priority to United States Provisional 
Application Serial No. 60/183,362, filed February 18, 2000 and entitled "Method of 
Reducing Display Power Through Image Subsampling." Applicant hereby asserts 
that it is a small entity as described under 37 C.F.R. § 1 .27 and is therefore entitled 
to a reduction in fees associated with the filing of this application. 

Field of the Invention 
[0002] The present invention relates generally to video displays. Particularly, the 
invention relates to video display power consumption. 

Background of the Invention 
[0003] Most displays attached to a computer are operated as a raster scan 
display. In a raster scan display device, the screen is assumed to consists of a two 
dimensional matrix. The displayed image is updated by sequentially passing an 
electron beam over horizontal lines of the matrix (Scan Lines) until every pixel of the 
matrix is updated. Raster scan systems use a memory buffer called a frame buffer 
(or refresh buffer). The data in the frame buffer is updated at least 60 times per 
second (60 Hz) so as to allow for displaying motion video. Accordingly, regardless 
of whether the image content has changed, the frame buffer, corresponding to a full 
screen, is updated every 1/60th of a second. This updating consumes valuable 
power, especially in portable devices. Therefore, there is a need for a method and 
system for reducing the power consumed by display devices. 
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Objects of the Invention 
[0004] It is therefore an object of the present invention to provide a method of 
reducing the power required to operate a display. 

[0005] It is another object of the present invention to reduce the overall systems 
costs for a video display, 

[0006] It is still another object of the present invention to provide a lightweight 
video display. 

[0007] It is yet another object of the present invention to provide a method of 
reducing power required to operate a display in connection with portable and/or 
wearable display systems. 

[0008] It is a further object of the present invention to provide a method of 
sampling input video information that reduces the size and cost of batteries required 
for a video display. 

[0009] It is still a further object of the present invention to provide a method of 
sampling input video information at a slower rate than conventional computer 
monitors. 

[0010] It is a further object of the present invention to provide a method of 
selectively receiving input video information whereby the power consumption of the 
display is reduced. 

[0011] It is yet a further object of the present invention to provide a system for 
image subsampling for a video display that is capable of being used in portable 
and/or wearable display system. 

[0012] It is another object of the present invention to provide a system for image 
subsampling that is capable of maintaining compatibility with existing architectures 
and components in video displays in order to remain cost effective. 
[0013] It is still another object of the present invention to provide a system for 
image subsampling for a video display that allows efficient storage and maintenance 
of image data between samplings. 
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[0014] It is yet another object of the present invention to provide a system for 
image subsampling for a video display that is frame-based. 

[001 5] It is a further object of the present invention to provide a system for image 
subsampling for a video display that is line-based. 

[0016] It is still a further object of the present invention to provide a system for 
image subsampling for a video display that is pixel-based. 

[0017] It is yet a further object of the present invention to provide a system for 
image subsampling for an active matrix video display. 

[0018] It is another object of the present invention to provide a system for image 
subsampling for an active matrix video display having cost-effective data storage. 
[0019] It is still another object of the present invention to provide a system for 
image subsampling for an active matrix video display having analog data storage. 
[0020] It is yet another object of the present invention to provide a system for 
image subsampling for an active matrix video display having digital data storage. 
[0021] It is a further object of the present invention to provide a system for image 
subsampling for an active matrix video display having both analog and digital data 
storage. 

[0022] It is still a further object of the present invention to provide a system for 
image subsampling for a video display capable of storing image information long 
enough to prevent flicker and other image degradation. 

[0023] It is yet a further object of the present invention to provide a system for 
image subsampling for a video display that is capable of permitting real-time 
information display. 

[0024] It is another object of the present invention to provide a method of reducing 
power consumption in a video display while permitting real-time information display. 
[0025] It is still another object of the present invention to provide a system for 
image subsampling for a video display that permits the low power mode to be 
switched in and out. 
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[0026] Additional objects and advantages of the invention are set forth, in part in 
the description which follows and, in part, will be apparent to one of ordinary skill in 
the art from the description and/or from the practice of the invention. 

Summary of the Invention 
[0027] In response to the foregoing challenge, Applicant has developed an 
innovative, economical video display device and method of sampling video input 
information. 

[0028] Most computer displays are used for office environment applications that 
do not require real-time updating bandwidth. In particular, portable displays such 
as those used with portable computers (notebooks, laptops, personal digital 
assistants, etc.) are seldom used for real-time video purposes. 
[0029] As display formats grow larger, the data bandwidth becomes faster and the 
power required to update the screen at 60 Hz (or higher) also increases. Most 
office-related applications rely on keyboard and mouse for input, leading to a much 
lower image update rate. A system taking advantage of this condition leads to a 
significant power consumption reduction, and therefore a longer life in 
battery-operated systems. 

[0030] In the present invention, Applicant discloses a function that can be added 
to the display controller. The function allows the input video information to be 
sampled at a slower rate than the typical 60-85 HZ presently used in most computer 
monitors. 

[0031] The present invention is accomplished by leveraging the densities offered 
by semiconductor processes. In order to sample the input information at a low rate, 
the display technology should be capable of holding the previous information long 
enough to prevent flicker and/or other degradation of the image. As contemplated 
in the present invention, a single silicon die includes: an array of pixel cells with 
storage, peripheral drivers to address and provide information to the array, an 
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interface to sample the incoming video information (analog or digital or both) and a 
control circuit that allows subsampling to reduce overall system power consumption. 
By combining this function with an active matrix display design that includes a 
storage element (analog, digital, or both), the power savings can be implemented 
successfully and cost effectively. 

[0032] The present invention builds the display on a silicon substrate that contains 
all the circuitry required to operate the display and store the image information. The 
present invention permits real-time video as well as low power/low update rate 
displays. The present invention achieves an overall reduction in power 
consumption. Although the image source is more complex, a simple reduction in 
sampling by half will reduce the power consumption of the interface and addressing 
circuitry almost as much. 

[0033] Furthermore, the present invention results in a reduction in overall system 
costs. The reduction in power required by the display leads to a lower power 
requirement at the system level. Therefore, a smaller and cheaper battery can be 
used to achieve the same performance as is available today. Also, the present 
invention results in no loss of functionality. The low power mode can be switched 
in and out by users at their discretion, by employing a control logic. 
[0034] The invention provides a method of sampling input video information in a 
video display device. The method includes the steps of providing an array of pixel 
cells with associated storage means disposed on a substrate, providing input video 
information to at least one peripheral driver, sampling the input video information 
with an interface, subsampling the input video information with a control circuit, 
addressing the input video information by the at least one peripheral driver to said 
array, storing the input video information for a time period sufficient to prevent image 
degradation, and displaying the input video information on a display. 
[0035] The invention also provides a display apparatus for displaying input image 
data. The display apparatus includes a display generator, which is adapted to 
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provide a display output by employing image data. The apparatus includes an 
image buffer coupled to the display generator, which is storing image data 
corresponding to the image data employed by the display generator. The apparatus 
also includes a reception circuit coupled to the image buffer. The reception circuit 
is receiving input image data, which is associated with a first data update rate. The 
reception circuit is adapted to selectively receive image data from said input image 
data at a second rate, which is lower than the first rate. The reception circuit is 
further adapted to update the image data in the image buffer with the selectively 
received image data whereby the power consumption of the display device is 
reduced by the selective receiving of the input image data. 

[0036] The invention also provides a method for reducing the power consumed 
by a display device. The method includes receiving input image data into the 
display device, the input image data received at a first rate, selectively storing the 
input image date at a second rate, the second rate is lower than the first rate, 
whereby the storing of the image data at the second rate consumed less power than 
the storing of the image data at the first rate, and providing the selectively stored 
data to the display image generation portion of the display device. 

Brief Description of the Drawings 
[0037] Figure 1 illustrates the structure of a display device of the invention, 
including a display generating portion, a memory module, a subsampling circuit, and 
a display data source; 

[0038] Figure 2 illustrates the structure of a subsampling circuit of the invention; 
[0039] Figure 3 illustrates the structure of a semiconductor substrate-based 
display device; 

[0040] Figure 4 is a flow diagram illustrating a frame subsampling operation; 
[0041] Figure 5 is a flow diagram illustrating a line subsampling operation; and 
[0042] Figure 6 is a flow diagram illustrating a pixel level subsampling operation. 
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Detailed Description of the Preferred Embodiment 
[0043] The structure and operation of an example display device is now described 
by referring to diagram and flow charts. The description is generally applicable to 
many structural implementations. Additionally, several variations of the disclosed 
methods are intended to be part of the invention. 

[0044] Figure 1 is a diagram for the general structure of a display device of the 
invention. The display device 21 includes a receiving circuit 24, a frame buffer 22, 
and a display generator 20. The receiving circuit 24 preferably receives image data 
from a video generation module 26. Such modules 26 include a video graphics 
card, a video graphics processor, and a main processor executing video update 
instructions. The image data are usually provided to the receiving circuit 24 at a rate 
of one frame in at least every 1/60 of a second. Accordingly, to capture all the 
information for a frame of the display image, the data provided to the receiving 
circuit are stored over a period of less than 1/60 of a second. This storage of an 
entire frame requires a bandwidth that is sufficient to transmit data relating to all 
image pixels during 1/60 of a second. Typical display resolution requires in the 
order of 100MHZ rates for properly updating the image data during this time. 
[0045] The receiving circuit 24 is coupled to a frame buffer 22 that is used to store 
the image data, which is employed to generate the displayed image. The receiving 
circuit 24 is coupled to the display generator 20 to provide image data for generating 
a display image. 

[0046] In operation, the receiving circuit 24 selectively receives image data from 
the video source 26. The selective receiving reduces the frequency of memory 
updates and therefore reduces the power consumed by the display device 21 as 
compared to a display that updates frame data at 60HZ. The received data are then 
provided to the frame buffer 22. The data are then preferably provided to the frame 
buffer 22 at the input data rate (60HZ). The display generator 20 reads the contents 
of the frame buffer 22 to generate a display image. In one implemention, the display 
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generator 20 accesses the frame buffer at 60HZ to operate as an ordinary raster 
type display. 

[0047] Figure 2 is an illustration of the logical structure of the receiving circuit 24 
that is used in the configuration that was described in Figure 1 . The receiving circuit 
24 includes a data sampling circuit 25, a memory module 28, a control logic 32, and 
an EPROM 30. The sampling circuit 26 is coupled to the control logic 32 to receive 
control signals which control the operation of the sampling circuit. The sampling 
circuit 26 is further coupled to a memory module 28 to store the sampled image 
data. The control logic 32 is coupled to the memory module 28 and to the EPROM 
30. The memory module 28 receives signals from the control logic 32, which control 
the transfer of memory content to the frame buffer. The EPROM 30 is used to store 
operating algorithm instructions that are used to guide the operation of the control 
logic 32. 

[0048] In operation, the control logic 32 executes a control algorithm as specified 
by reference to the EPROM 30 contents. The control logic 32 directs the operation 
of the sampling circuit 26 to capture image data at a rate that is less than that at 
which the data are provided to the sampling circuit (e.g., 60HZ). The captured data 
are then provided to the memory module 28. Preferably, after data for an entire 
frame are in the memory module 28, the data are provided to the frame buffer so as 
to update the image frame data. 

[0049] Figure 3 illustrates the structure of a semiconductor based display device 
34 that includes a receiving circuit, a frame buffer, and a display generator as part 
of a single silicon substrate. The integrated device includes a first semiconductor 
layer 36 that holds the logical components of the device. A second layer 37 is used 
to transport signals to a display layer 38. The display layer 38 includes a plurality 
of light emitting elements, preferably arranged as a matrix. The logical components 
store the image data that are used to direct control signals to power the individual 
emitting elements of the display layer 38. 
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[0050] In operation, the logical components in the first semiconductor layer 36 
receive the input image data. A sampling circuit in the first layer 36 subsamples the 
input image data. The sampled image data are then provided to an interface 
controller that directs the image data to a memory module. The memory module is 
an array of storage elements that preferably stores data corresponding to each pixel 
in the display layer 38. The data from each storage element are then used to 
determine when to power corresponding pixels. 

[0051] In accordance with the present invention, several methods of image 
subsampling are contemplated in order to reduce the power required for displays. 
All of the following methods subsample the input image data, each employing a 
specific algorithm. 

Frame-based Sampling 
[0052] Figure 4 is a flow diagram of an operational embodiment of the present 
invention, where the sampling of the input image data is accomplished on a per- 
frame basis. A frame-based subsampling of the input image data entails storing 
select frames of the input image data. Accordingly, the data in the display are 
updated every n frames instead of updating every frame. The value of n is selected 
by reference to the performance requirements for the display device. For example, 
the value of n is set higher in a system that does not receive moving image data 
than the setting in a system that frequently displays some form of moving image 
data. Furthermore, the value of n depends on the silicon process capabilities 
(leakage), as well as on the design of the pixels in the display and the display 
operation. 

[0053] The example implementation of figure 4 uses one method to skip n frames 
from the received input frames. However, other methods can be used to skip 
frames. In one implementation, a counter is initialized to a value, which is zero in 
the example (step 40). The control logic determines whether the counter value is 
the starting value to which the counter was initialized (step 42). If the counter value 
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is the starting value, the control logic waits to detect the vertical synchronization 
signal that indicates the start of an image frame (step 44). The data for the frame 
are then used to update the data in the memory buffer of the receiving circuit (step 
46). The counter is then incremented by n units (step 48). In the example provided , 
the counter is directly set to n because the initial value was zero. When the counter 
value in step 42 is not the starting value (e.g. zero), the control logic waits for the 
vertical synchronization signal (step 50). However, at this point in the algorithm, the 
frame data are not used to update the memory buffer but rather are ignored. 
Instead, the control logic decrements the counter by one unit (step 52). As may be 
appreciated from this description, the algorithm has the effect of updating the 
memory buffer with frame data every n frames. 

[0054] As may be appreciated, the average power saved grows as n grows. 
Assuming, for example, a typical keyboard entry updates the image at about 20 Hz, 
switching to the power saving mode (/?=3) potentially reduces the average display 
addressing power by almost 3. The frame-based implementation does not change 
the existing display design architecture and therefore allows for backwards 
compatibility with existing display devices. The frame-based subsampling method 
requires full bandwidth during the sampling intervals because the entire frame data 
are sampled during a single iteration. 

Line-based Sampling 
[0055] Figure 5 is a flow diagram of another operational embodiment of the 
present invention, where the sampling of the input video information is accomplished 
on a line basis. In this embodiment, rather than sampling the information one frame 
at a time, the information is sampled over several frames, by selecting lines to be 
sampled from each received input frame. A counter is used to keep track of which 
lines are to be sampled during the next frame. 

[0056] The control logic begins by initializing two variables, m and p, to a starting 
line number and an ending line number, respectively (step 54). Preferably, m is set 
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to zero and p is set to the end of the first segment of lines. The control logic then 
waits for the vertical synchronization signal (step 56). When the signal is detected, 
the control logic directs the sampling circuit to receive data from the input frame 
corresponding to starting line m and ending line p (step58). Accordingly, data for 
the selected lines are received into the memory buffer. The control logic then 
determines if the value of p is for the last line of the frame (step 60). If the value of 
p is the end of frame line, the control logic sets m back to zero and sets p to the end 
of the first segment of lines (steps 62, 64). If the value of p is not the end of frame 
line, the control logic sets m to one line over p and sets p to the end of the next 
segment of lines (steps 66, 68). The vertical synchronization signal is then detected 
and the process repeats. As may be appreciated, the determination of how many 
line to scan can be set by the programming of the control logic. Smaller line 
segments may suit devices where higher bandwidth is not available. Furthermore, 
select lines of the frame can be updated more frequently in devices that update 
some lines more frequently, such as cellular telephones. Also, this technique is 
advantageous for low information content displays, such as those used with 
personal digital assistants (PDAs), wireless phones or other personal 
communication devices, which typically receive information on a line-by-line basis 
over a longer time period than real-time displays. 

Pixel-based Sampling 
[0057] Figure 6 is a flow diagram of another operational embodiment of the 
present invention, where the sampling of the input video information is accomplished 
on a pixel basis. The pixel-based sampling corresponds to display devices such as 
the device of Figure 3, where a each pixel is associated with a memory element. 
In this approach, the display architecture is implemented as a memory array with an 
interface controller that routes the information to the appropriate area. The display 
can still appear as a raster-scanned display to the host by employing a peripheral 
driver for adressing the pixel array memory elements. 
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[0058] In the memory array configuration, each pixel cell is independently 
addressed as an individual element of the memory. The display pixel array includes 
row and column selection lines, which are controlled by an address decoder that 
resides within the display device. The display is thus addressed more like a random 
access memory (RAM) rather than as a raster scan display. The video data source 
for such a device provides a pixel address as well as a pixel data value, similar to 
how a microprocessor addresses a memory buffer. This allows updates to the 
display only where the source data has changed, and therefore further reduces the 
bandwidth and power requirements. This approach is most effective for bi-level 
displays where a simple static RAM cell is implemented at each pixel cell. 
[0059] Referring back to Figure 6, the receiving circuit receives input frame data 
from the display source (step 70). The data are then routed to the appropriate pixel 
memory location in accordance with the arrangement in the particular display device 
(step 72). The memory locations are updated as frequently as needed for the 
particular display device usage. When the control logic determines that an update 
is needed (step 74), the memory locations corresponding to the pixels are updated 
with corresponding data (step 76). 

[0060] While this invention has been described in conjunction with specific 
embodiments thereof, it is evident that many alternatives, modifications and 
variations will be apparent to those skilled in the art. Accordingly, the preferred 
embodiments of the invention as set forth herein are intended to be illustrative, not 
limiting. Various changes may be made without departing from the spirit and scope 
of the invention. 



561901 



12 



